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APPARATUS, SYSTEM AND METHOD FOR IMAGE PROCESSING 

[0001] This application is based on application No. 2000- 
180061, filed in Japan, the contents of which are hereby 
incorporated by reference. 

BACKGROUND OF THE INVENTION 
FIELD OF THE INVENTION 

[0002] The present invention relates to image processing for 
preventing forgery of paper money, securities and the like. 

DESCRIPTION OF PRIOR ART 

[0003] Recently, a peripheral of a computer such as a scanner 
or a color printer has improved functions and higher performance, 
and a possibility is increased that an average consumer can copy 
paper money, securities and the like easily. Then, effective 
countermeasures for preventing forgery have been developed. 
One of methods for preventing forgery is to include a specified 
pattern in a design of paper money or the like. The specified 
pattern is embedded in an image so as not to be noticed by a 
user in the standpoint of prevention of forgery. Image data 
is analyzed before printing, and when the specified pattern is 
detected in the image data, normal print operation is stopped. 
[0004] However, in the prior art technique for preventing 
forgery in image forming, an input device is fixed as an input 
system, and the detection of a specified pattern is performed 
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on data depending on the input device . Therefore, the technique 
cannot be applied to a print system or an image forming device 
to which a plurality of input devices can be connected. That 
is, even when correct detection is possible on image data 
received from a particular input device, it may not be so for 
image data received from another input device having different 
characteristics. Therefore it is desirable to detect a 
specified pattern in an output device independent of the input 
device . 

SUMMARY OF THE INVENTION 

[0005] An obj ect of the present invention is to prevent forgery 
in an image forming apparatus or system having a plurality of 
input systems, independently of input system. 
[0006] In one aspect of the invention, in an image processor 
processes input image data and sends the processed data to an 
image output device, a memory device stores output inhibition 
conditions for inhibiting print of an image including a specified 
pattern. A first converter converts the input image data to 
first image data for image forming. On the other hand, a second 
converter converts the input image data to second image data in 
correspondence to a state of a print obtained by the image output 
device, and a detector detects the specified pattern in the second 
image data based on the output inhibition conditions. A 
controller controls the output of the first image data according 
to a result of the detection. 
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[0007] In another aspect of the invention, in an image 

processor processes input image data and sends the processed data 
to an image output device, a memory device stores output 
inhibition conditions for inhibiting print of an image including 
a specified pattern. A converter converts the output inhibition 
conditions to detection parameters according to output 
characteristics of the image output device, and a detector 
detects the specified pattern in the input image data based on 
the detection parameters. A controller controls the output of 
the processed image data according to a result of the detection. 

[0008] An advantage of the present invention is that an image 
processor or a system which does not depend on the input system 
on the prevention of forgery can be constructed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] These and other objects and features of the present 
invention will become clear from the following description taken 
in conjunction with the preferred embodiments thereof with 
reference to the accompanying drawings, and in which: 
[0010] Fig. 1 is a diagram of an image processing system; 
[0011] Fig. 2 is a diagram for explaining an example of an 
output prohibition condition; 

[0012] Fig. 3 is a diagram of a composite of lookup tables; 
[0013] Fig. 4 is a flowchart of image processing in a first 
embodiment ; 

[0014] Fig. 5 is a flowchart of setting of detection parameter 
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in a second embodiment 

[0015] Fig. 6 is a flowchart of image output in a second 
embodiment; and 

[0016] Fig. 7 is a flowchart of processing to calculation of 
detection parameter in a system of a fourth embodiment. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0017] Referring now to the drawings, wherein like reference 
characters designate like or corresponding parts throughout the 
several views, Fig. 1 shows an image processing system having 
a plurality of image input devices. In this system, in order 
to prevent forgery, a specified pattern included in a document 
image is detected in input image data, and when the specified 
image or pattern is detected, output of the image data is 
inhibited. A computer 10 controls the entire system. The 
computer 10 has a central processing unit (CPU) , a read-only 
memory (ROM) and a random access memory (RAM) . Further, it 
includes a flexible disk drive, a hard disk drive, and a CD- 
ROM drive for memory media of a flexible disk 10a, a hard disk 
and a CD-ROM. An image processing program shown in Figs. 4 to 
7 is read from such a recording medium. The computer 10 is 
connected to a scanner 12 and a digital camera 14 as an image 
input device. Further, the computer 10 is also connected to a 
plurality of printers 16 and 18 as an image output device for 
outputting the image data. When an image is formed, the computer 
10 calculates color, size, resolution and the like of a hard copy 
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of the output image, based on the data received from the image 
input device 12, 14 and output characteristics of the printer 
16, 18. Then, the computer 10 detects the specified pattern and 
decides to permit or inhibit the image formation. Further, the 
computer 10 can be connected to a different image input device 
or to a different image output device through a network 10. It 
is to be noted that "input image" includes not only an image 
received by the computer 10 from an external image input device, 
but also an image generated in the computer 10. The above- 
mentioned system structure is common to other embodiments 
explained later. 

[0018] As will be explained below, this system detects a 
specified pattern in an image with reference to a hard copy. In 
order to construct a system which does not depend on an input 
system on the detection of specified pattern, it is needed in 
this system that input data has a correspondence with a print 
color for the same printer setting. That is, if input data is 
the same, the colorimetry values of print color in a bard copy 
has to be the same generally. Therefore, if a driver or the like 
corrects an image such as color correction or automatic contrast 
correction for each area, the specif ied pattern is detected after 
removing the correction functions or by using the data after 
applying the correction functions. 

[0019] Fig. 4 shows a flow of image processing (including the 
detection of specified pattern) by the computer 10. First, 
output inhibition conditions are determined (SI 00) and stored 
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in a memory device in this system. The output inhibition 
conditions represent conditions used to detect a specified 
pattern or image included in an image and not to be outputted 
as a hard copy and they have been determined beforehand. The 
output inhibition conditions define size and color of the 
specified pattern, and size, contrast, output resolution of the 
specified image, and the like. The output inhibition conditions 
have values which can be defined irrespective of input data type 
and characteristics of the printer 16, 18. This type of 
prevention of forgery becomes necessary when a very fine color 
image is outputted. Therefore, the specified pattern is 
detected only for a full color image or a high resolution image 
of 600 dots per inch (dpi) or higher. Fig. 2 shows examples of 
a specified pattern and a specified image and the output 
inhibition conditions thereon. As to the specified pattern 
("Confidential"), conditions on the size and color thereof are 
determined, while as to the specified image, conditions on image 
size and output resolution are determined. As to the size, image 
subjected to conversion between vertical and horizontal 
directions or rotation is also an object of the detection. 
[0020] Next, a normal conversion table is generated for each 
printer 16, 18 (S102) . The normal conversion table correlates 
the input data with a printout or hard copy outputted by the 
printer, and it is used to calculate an output product based on 
input data. The format of the normal conversion table is a 
multi-dimensional look-up table (LUT) , a conversion matrix, a 



- 7 - 



mathematical formula or a combination thereof. Fig. 3 shows an 
example of a combination of one-dimensional and three- 
dimensional look-up tables. The one-dimensional look-up tables 
are used for one-dimensional conversion of data. 
[0021] Next, an example of generation of a normal conversion 
table is explained. In this example, a three-dimensional 
look-up table on size, resolution and color of the image (or 
pattern) is generated. As to the size of image (or pattern) , 
a formula is provided to calculate the size of output image (or 
pattern) based on the output magnifying power and the size of 
input image (or pattern) set in a printer driver or the like. 
The formula may be a simple one as shown below. 

Lx = (X/P) *N*25.4, 
wherein Lx denotes size of the output image in the horizontal 
direction (in the unit of mm) , X denotes a number of pixels in 
the horizontal direction of the image, P denotes resolution of 
the input image (in the unit of dots per inch) , and N denotes 
output magnifying power. As to the resolution of the image (or 
pattern) , a formula is provided to calculate the resolution of 
output image (or pattern) based on the output magnifying power 
and the resolution of input image (or pattern) , and print 
precision set in a printer driver or the like. As to the color 
of the image (or pattern) , an image of a color chart is formed 
to generate a look-up table. That is, specified image data in 
the printer or in the printer- driver are sent to print the color 
chart. Then, the obtained print of the chart is determined with 
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a measuring instrument, so that a correspondence between the 
input image signals and the measurement values on the print or 
hard copy is determined to generate the look-up table. 

[0022] The above-mentioned determination of the output 

inhibition conditions (SI 00) and the generation of the normal 
conversion table (S102) are performed at least once for one model 
of printer. In other words, it is performed for each of the 
printers 16 and 18. Further, by changing the setting conditions 

(types of paper and ink, print mode and the like) for each printer, 
the above-mentioned processing is repeated. Thus, the normal 
conversion table is generated for each of the printer setting 
conditions . 

[0023] Next, data are received from the image input device and 
are sent to the image output device. The detection of the 
specif ied pattern is performed for each image output, in parallel 
to the normal image output processing. First, an image data is 
received from the image input device (SI 04) , and image correction 
is performed on the input image (S106) . For example, the image 
is divided into areas, and color correction, contrast correction 
or the like is performed on each area. Next, the image data is 
converted for ordinary image forming (S108) . The conversion for 
ordinary image forming includes, for example, the density 
conversion of the image data and the conversion to the data on 
ink colors for cyan (C) , magenta (M) , yellow (Y) and black (K) . 

[0024] On the other hand, in parallel to the above processing, 
normal conversion is performed on the input image data after the 
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image correction <S110) . By using the formula generated in the 
generation of the normal conversion table, the size and the 
resolution of the output image are calculated. (The actual image 
data may be enlarged or reduced.) Further, the color of the input 
image data is converted by using the look-up table. The image 
data after the conversion is very similar to the resultant color 
of the print or hard copy. 

[0025] Next, the specified image is detected according to the 
output inhibition conditions (S112) . It is decided whether the 
image obtained by the normal conversion of the input image 
satisfies the output inhibition conditions. A known technique 
is used for the detection using the output inhibition conditions . 
As explained above, the detection is performed after converting 
the input data to data of the color and size of an output image 
of a print (hard copy) . Therefore, a result of the detection 
in this step is similar to a result when the detection is performed 
on an actual hard copy. When the image data obtained by the 
normal conversion of the input image data satisfies the output 
inhibition conditions, it is decided that the specified pattern 
is detected. 

[0026] Next, according to the result of the detection of 
specified image (S112) , it is decided to output the imaged data 
obtained by the data conversion at step S10 6 to the image output 
device or not, and the output control (that is, print stop at 
the image output device or execution of abnormal printing) is 
performed (S114) . As to the output control, a known technique 
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is used. If the specified image is not detected, the image data 
subjected to the data conversion is outputted to the image 
output device (S116) , to form the image on a sheet of paper. 
The steps S100 to S102 may be performed in a system different 
from this system to determine the output inhibition conditions 
and the normal conversion tables preliminarily, and the 
processing at step S104 and the following may be performed by 
using the results. 

[0027] Next, a system according to a second embodiment is 
explained. In this system, the output inhibition conditions 
which have been set beforehand are converted to detection 
parameters for input data based on the output characteristics. 
The output inhibition conditions are set independently of the 
input device and the output device. Next, an image data is 
received, and the specified pattern is detected in the image 
data by using the detection parameters. Then, the permission 
or inhibition of the output of the input image is decided 
according to the detection result. Because the detection 
parameters obtained by converting the output inhibition 
conditions based on the output characteristics are used, the 
detection can be performed at a higher speed than the conversion 
of the entire input image. Further, the detection result 
according to the output characteristics can be provided. The 
image processing of the computer 10 in this embodiment is 
explained below. 

[0028] Fig. 5 shows a flow until the calculation of the 
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detection parameters. Determination of the output inhibition 
conditions (S200) and generation of the normal conversion 
tables for each printer (S202) are performed similarly to the 
counterparts in the above-mentioned first embodiment. As to 
the normal conversion table, a three-dimensional look-up table 
of the size, resolution and color of image (pattern) are 
generated, similarly to in the first embodiment. The normal 
convrsion table is generated for each printer. Next, reverse 
conversion tables are generated by using the normal conversion 
tables generated at step S202 (S204) . The reverse conversion 
tables are generated as follows. As to the size of the image 

(or pattern) , the formula for the normal conversion is modified, 
so that a formula is provided to calculate the size of input image 

(or pattern) based on the magnifying power and the size of output 
image (or pattern) set in a printer driver or the like. As to 
the resolution of the image (or pattern) , a formula is provided 
to calculate the resolution of input image (or pattern) based 
on the magnifying power and the resolution of output image (or 
pattern) , and print precision set in a printer driver or the like . 
As to the color of the image (or pattern) , a look-up table for 
reverse conversion is generated by using the look-up table for 
the normal conversion. That is, specified image data in the 
printer or in the printer driver are sent to produce a print. 
Then, the obtained print is measured with a measuring instrument, 
so that a correspondence between the input image signals and the 
measurement values on the print is determined to generate the 
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look-up table. 

[0029] Next, reverse conversion of the output inhibition 
conditions is performed (S206) . According to the reverse 
conversion table prepared at step S2 04, the numerical values and 
the like of the output inhibition conditions are converted to 
data at the image input. As to parameters (for example threshold 
values of L, C and H in LCH space) such as a range of color which 
cannot be converted, a plurality of colors which satisfy the 
parameter are taken out, and they are converted. Next, the 
detection parameters are calculated (S208) . The conditions 
obtained by the reverse conversion at step S206 may not be 
favorable for actual detection. Then, calculation is performed 
further based on the conditions obtained by reverse conversion, 
to convert detection parameters in a format suitable for the 
actual detection operations . For example, in the example at step 
S206, the result of the reverse conversion is a plurality of color 
coordinates in a color space of the input data. A color area 
is calculated which includes all the plurality of color 
coordinates and are represented as parameters convenient for the 
detection (for example, threshold values of R, G and B in RGB 
space) . As to the size of the image (or pattern) , the formula 
obtained at step S204 may be used without modification. However, 
if the type of magnifying power which can be set for output is 
limited, it maybe defined in a one-dimensional look-up table. 
The detection parameters obtained above are stored in a parameter 
table. 
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[0030] The above-mentioned determination of the output 

inhibition conditions (S200) and the generation of the normal 
conversion table (S202) are performed at least once for one model 
of printer. In other words, it is performed for each of the 
printers 16 and 18. Further, by changing the setting conditions 
(types of paper and ink, print mode and the like) for each printer, 
the above-mentioned processing is repeated. Thus, the normal 
conversion table is generated for each of the printer setting 
conditions . 

[0031] Fig. 6 shows a flow of image processing in the second 
embodiment wherein data is received from an image input device 
and is outputted to an image output device. The detection of 
a specified pattern is performed for each image output, in 
parallel to ordinary image output processing. First, an image 
is received from an image input device (S220) , and image 
correction is performed on the input image (S222) . The image 
is divided into areas, and color correction, contrast correction 
or the like is performed on each area. Next, data conversion 
for image forming is performed (S224) . This conversion is common 
to that in the first embodiment. On the other hand, it is detected 
whether the input image data satisfies the output inhibition 
conditions, by using the detection parameters in the parameter 
table (determined in the processing in Fig. 5) (S226) . As to 
the detection process, a known technigue is used. Because the 
specified pattern is detected by using the detection parameters, 
without performing the normal and reverse conversions of the 
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image, the detection can be performed at a higher speed. 
[0032] Next, the output is controlled (S228) . It is 

determined according to the result of the detection of the output 
inhibition conditions whether the image is formed or not (S22 6) , 
and the output control (print stop or execution of abnormal 
printing) is performed. A known technique is adopted for the 
technique for the output control. If the output inhibition 
conditions are not detected, the image is formed on a sheet of 
paper (S230) . 

[0033] Next, a system according to a third embodiment is 
explained. This system is used when a printer such as a printer 
supporting sRGB is used wherein output color is determined in 
correspondence to input data. It is a modification of the 
system of the second embodiment. Practically, in the 
processing of the second embodiment shown in Fig. 5, the process 
for generating tables for color is deleted in the generation 
of normal conversion table at step S2 02 and in the generation 
of reverse conversion table at step S204. Further, in the 
reverse conversion of the output inhibition conditions at step 
S206, the conversion is performed by using the correspondence 
of the output color with the input color defined for each printer . 
For example, in a printer which supports sRGB, output color X, 
Y and Z is converted with a following formula to input data R sRGB , 
G srgb and B sRGB . The remainder is similar to the counterpart in 
the system of the second embodiment, and the explanation 
therefor is omitted here. When normal conversion tables are 
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used, the correspondence between output color and input color 
may be determined by searching the normal conversion tables, 
without generating reverse conversion tables. 
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[0034] Next, a system according to a fourth embodiment is 
explained. This system is also a modification of the system 
of the second embodiment on the color. Fig. 7 shows processing 
until the calculation of the detection parameters. First, 
output inhibition conditions are set (S300) , wherein at least 
one of colors to be detected and not to be detected is defined. 
The color not to be detected is determined by considering the 
color of the specified pattern and that of the neighborhood 
thereof. Thus, it is not needed to determine a specified color 
range in the output inhibition conditions of color. Next, 
normal conversion tables for each printer is generated (S302) . 
Then reverse conversion tables for each printer is generated 
(S304) . Next, reverse conversion of the output inhibition 
conditions is performed (S306) , wherein the colors to be 
detected and not to be detected defined at step S300 are 
converted by reverse conversion tables. Next, the color range 
(or a color range including the converted colors to be detected 
and not including the converted colors not to be detected) to 
be detected is determined (S308) . Next, detection parameters 
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which represent the detection range are set (S310) . The image 
output is performed with use of the detection parameters as in 
the second embodiment. 

[0035] In the embodiments explained above, the output 

inhibition conditions are determined based on printouts or hard 
copies, independently of input and output systems. Therefore, 
an image processor or a system which do not depend on the input 
system can be constructed. Further, because the detection is 
performed after converting the input image to data of color, 
size and the like of images after outputting them, a detection 
result is similar to that on actual print images. 
[0036] Further, the detection is performed by converting the 
output inhibition conditions determined with use of the print 
images to parameters for input data, based on the output 
characteristics. Therefore, the specified pattern can be 
detected at higher speed than in the converting of all the image . 
Further, the detection result in correspondence to the output 
characteristics can be obtained. 

[0037] Although the present invention has been fully 

described in connection with the preferred embodiments thereof 
with reference to the accompanying drawings, it is to be noted 
that various changes and modifications are apparent to those 
skilled in the art. Such changes and modifications are to be 
understood as included within the scope of the present invention 
as defined by the appended claims unless they depart therefrom. 



